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DETAILED ACTION 

Claim Objections 

1 . Claim 1 , 8 and 1 5 are objected to because of the following informalities: 
Regarding claim 1 , 8 and 15 the term "each of which is made up of ..." does not 

define what "each" is. For the purpose of examination the examiner assumes that 
"each" refers to each region of motion. 
Appropriate correction is required. 

Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

3. Claims 7 and 14 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

In regards to claim 7 and 14, the term "class tap" is not defined nor is it well 
known in art. The term "class tap" is only mentioned in the specification on pg 7 lines 
15-27. 



Claim Rejections - 35 USC § 101 
4. 35 U.S.C. 101 reads as follows: 
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Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex IV, 
reads as follows: 

Descriptive material can be characterized as either "functional descriptive material" or "nonfunctional 
descriptive material." In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer component. (The 
definition of "data structure" is "a physical or logical relationship among data elements, designed to 
support specific data manipulation functions." The New IEEE Standard Dictionary of Electrical and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes but is not limited 
to music, literary works and a compilation or mere arrangement of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most cases since use of 
technology permits the function of the descriptive material to be realized. Compare In re Lowry, 32 
F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a 
computer readable medium that increases computer efficiency held statutory) and Warmerdam, 33 
F.3d at 1 360-61 , 31 USPQ2d at 1 759 (claim to computer having a specific data structure stored in 
memory held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 
1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer 
element which defines structural and functional interrelationships between the computer program and 
the rest of the computer which permit the computer program's functionality to be realized, and is thus 
statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 1035. 



Claim 15 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. 

Claim 15 defines a program embodying functional descriptive material. 
However, the claim does not define a "computer-readable medium or computer- 
readable memory" and is thus non-statutory for that reason (i.e., "When functional 
descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most 
cases since use of technology permits the function of the descriptive material to be 
realized" - Guidelines Annex IV). The scope of the presently claimed invention 
encompasses products that are not necessarily computer readable, and thus NOT able 
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to impart any functionality of the recited program. The examiner suggests amending the 
claim(s) to embody the program on "computer-readable medium" or equivalent; 
assuming the specification does NOT define the computer readable medium as a 
"signal", "carrier wave", or "transmission medium" which are deemed non-statutory 
(refer to "note" below). Any amendment to the claim should be commensurate with its 
corresponding disclosure. 
Note: 

"A transitory, propagating signal ... is not a "process, machine, manufacture, or 
composition of matter." Those four categories define the explicit scope and reach of 
subject matter patentable under 35 U.S.C. § 101 ; thus, such a signal cannot be 
patentable subject matter." (In re Petrus A.C.M. Nuijten; Fed Cir, 2006-1371 , 
9/20/2007). 

Should the full scope of the claim as properly read in light of the disclosure 
encompass non-statutory subject matter such as a "signal", the claim as a whole would 
be non-statutory. In the case where the specification defines the computer readable 
medium or memory as statutory tangible products such as a hard drive, ROM, RAM, 
etc, as well as a non-statutory entity such as a "signal", "carrier wave", or "transmission 
medium", the examiner suggests amending the claim to include the disclosed tangible 
computer readable media, while at the same time excluding the intangible media such 
as signals, carrier waves, etc. 
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Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

6. Claims 1-5, 8-12 and 15 rejected under 35 U.S.C. 102(b) as being anticipated 
by Kondo et al. (PGPub #2004/0021775), hereafter referred to as Kondo. 

Regarding claim 1, Kondo discloses an apparatus for processing an image, said 
apparatus comprising: 

motion vector detection means (Kondo, Fig. 2 #102, "Movement Detecting Unit") 
for detecting a motion vector about a moving object (Kondo, Fig. 2 "Movement vector 
and Position information thereof".) that moves in multiple images, each of which is made 
up of multiple pixels and acquired by an image sensor having time integration effects, 
and tracking the moving object; (Kondo, y[1251j, "In the above, an example has been 
given of a case of projecting images in real space having three-dimensional space and 
time-axis information onto time-space having two-dimensional space and time-axis 
information, using a video camera") 

motion-blurring-mitigated object image generation means for generating a 
motion-blurring-mitigated object image in which motion blurring occurred in the moving 
object in each image of the multiple images is mitigated by using the motion vector 
detected by the motion vector detection means; and (Kondo, Fig. 2 #106, "Movement 
Blurring Adjustment Unit") 
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output means for combining the motion-blurring-mitigated object image that is 
generated in the motion-blurring-mitigated object image generation means into a space- 
time location, in each image, corresponding to the motion vector, said motion vector 
being detected by the motion vector detection means, to output it as a motion- blurring- 
mitigated image. (Fig. 137, "Image Synthesizing Unit", where the "Background 
Component Image" and "Foreground Component Image" are combined) 

Regarding claim 2, Kondo discloses the apparatus for processing the image 
according to claim 1, 

wherein the motion vector detection means sets a target pixel corresponding to a 
location of the moving object in any one of at least a first image and a second image, 
which are sequential in terms of time, and detects a motion vector corresponding to the 
target pixel by using the first and second images; and (Kondo, W001 1], "movement 
vector for indicating relative movement between the pixel data of the frame of interest 
and the pixel data of the adjacent frame") 

wherein the output means combines the motion-blurring- mitigated object image 
into a location of the target pixel in said one of the images or a location corresponding to 
the target pixel in the other image, said locations corresponding to the detected motion 
vector. (Kondo, ^[0012], "output as first difference image data, and calculate difference 
based on the mixture ratio of the pixel of interest of the frame of interest between each 
pixel of the frame of interest of the image data and each pixel of a second adjacent 
frame adjacent to the frame of interest of the image data, and output as second 
difference image data") 
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Regarding claim 3, Kondo discloses the apparatus for processing the image 
according to claim 1, 

wherein in a processing region of the image, the motion- blurring-mitigated object 
image generation means turns into a model so that a pixel value of each pixel in which 
no motion blurring corresponding to the moving object occur becomes a value obtained 
by integrating the pixel value in a time direction with the pixel being moved 
corresponding to the motion vector (Kondo, Fig. 13, where the pixels not changed in the 
time direction are set at the background region) and 

generates a motion- blurring-mitigated object image in which motion blurring of 
the moving object included in the processing region is mitigated, based on the pixel 
value of the pixel in the processing region. (Kondo, Fig. 2, where the motion blurring is 
mitigated by the movement vector which is based on pixel value processing of the 
object) 

Regarding claim 4, Kondo discloses the apparatus for processing the image 
according to claim 3, wherein the motion-blurring-mitigated object image generation 
means includes: 

region identification means for identifying a foreground region, a background 
region, and a mixed region in the processing region, said foreground region being 
composed of only a foreground object component constituting a foreground object 
which is moving object, said background region being composed of only a background 
object component constituting a background object, and said mixed region mixing the 
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foreground object component and the background object component; (Kondo, Fig. 6A 
and 6B shows the detection of the background, foreground and mixed regions.) 

mixture ratio detection means for detecting a mixture ratio of the foreground 
object component and the background object component in the mixed region; (Kondo, 
Fig. 2 #104, and "Mixture Ratio Calculating Unit") 

separation means for separating at least a part of region of the image into the 
foreground object and the background object, based on the mixture ratio; and (Kondo, 
Fig. 2 #105, "Foreground/Background Separation Unit") 

motion-blurring-adjusting means for mitigating motion blurring of the foreground 
object separated by the separation means based on the motion vector. (Kondo, Fig. 2 
#106, "Movement Blurring Adjustment Unit") 

Regarding claim 5, Kondo discloses the apparatus for processing the image 
according to claim 3, 

wherein the motion vector detection means detects the motion vector every pixel 
in the image; and (Kondo, ^[0018], "generating movement vector information indicating 
each of the generated movement vectors; wherein, in the weighted difference image 
data calculating step, the weighted difference is calculated based on the weighting 
indicated by the weighting information between each pixel of the frame of interest of the 
image data and each pixel of the adjacent frame adjacent to the frame of interest of the 
image data,", where the motion vector is generated for each pixel) 

wherein the motion-blurring-mitigated object image generation means sets the 
processing region according to the motion vector of the target pixel in the image so that 
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the processing region includes the target pixel, and outputs pixel value in which motion 
blurring of the target pixel is mitigated in pixel units based on the motion vector of the 
target pixel. (Kondo, Fig. 2, where the "Movement Blurring Adjustment Unit" takes in the 
movement vector and outputs the foreground component with the movement blurring 
being mitigated.) 

Regarding claim 8, Kondo discloses a method for processing an image, said 
method comprising: 

motion-vector-detecting step (Kondo, Fig. 2 #102, "Movement Detecting Unit") of 
detecting a motion vector about a moving object that moves in multiple images, each of 
which is made up of multiple pixels and acquired by an image sensor having time 
integration effects, and tracking the moving object; (Kondo, Fig. 2 "Movement vector 
and Position information thereof".) (Kondo, ^[1251], "In the above, an example has been 
given of a case of projecting images in real space having three-dimensional space and 
time-axis information onto time-space having two-dimensional space and time-axis 
information, using a video camera") 

motion-blurring-mitigated-object-image-generating step of generating a motion- 
blurring-mitigated object image in which motion blurring occurred in the moving object in 
each image of the multiple images is mitigated by using the motion vector detected in 
the motion-vector-detecting step; and (Kondo, Fig. 2 #106, "Movement Blurring 
Adjustment Unit") 

output step of combining the motion-blurring-mitigated object image that is 
generated in the motion-blurring-mitigated-object- image-generating step into a space- 
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time location, in each image, corresponding to the motion vector, said motion vector 
being detected in the motion-vector-detecting step, to output it as a motion- blurring- 
mitigated image. (Fig. 137, "Image Synthesizing Unit", where the "Background 
Component Image" and "Foreground Component Image" are combined) 

Regarding claim 9, Kondo discloses the method for processing the image 
according to claim 8, wherein the motion-vector-detecting step sets a target pixel 
corresponding to a location of the moving object in any one of at least a first image and 
a second image, which are sequential in terms of time, and detects a motion vector 
corresponding to the target pixel by using the first and second images; and (Kondo, 
y[0011], "movement vector for indicating relative movement between the pixel data of 
the frame of interest and the pixel data of the adjacent frame") 

wherein the output step combines the motion-blurring-mitigated object image into 
a location of the target pixel in said one of the images or a location corresponding to the 
target pixel in the other image, said locations corresponding to the detected motion 
vector. (Kondo, ^[0012], "output as first difference image data, and calculate difference 
based on the mixture ratio of the pixel of interest of the frame of interest between each 
pixel of the frame of interest of the image data and each pixel of a second adjacent 
frame adjacent to the frame of interest of the image data, and output as second 
difference image data") 

Regarding claim 10, Kondo discloses the method for processing the image 
according to claim 8, wherein in a processing region of the image, the motion-blurring- 
mitigated-object-image-generating step turns into a model so that a pixel value of each 
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pixel in which no motion blurring corresponding to the moving object occur becomes a 
value obtained by integrating the pixel value in a time direction with the pixel being 
moved corresponding to the motion vector and (Kondo, Fig. 13, where the pixels not 
changed in the time direction are set at the background region) 

generates a motion-blurring-mitigated object image in which motion blurring of 
the moving object included in the processing region is mitigated, based on the pixel 
value of the pixel in the processing region. . (Kondo, Fig. 2, where the motion blurring is 
mitigated by the movement vector which is based on pixel value processing of the 
object) 

Regarding claim 11, Kondo discloses the method for processing the image 
according to claim 10, wherein the motion-blurring-mitigated-object-image-generating 
step includes: 

region identification step of identifying a foreground region, a background region, 
and a mixed region in the processing region, said foreground region being composed of 
only a foreground object component constituting a foreground object which is moving 
object, said background region being composed of only a background object component 
constituting a background object, and said mixed region mixing the foreground object 
component and the background object component; (Kondo, Fig. 6A and 6B shows the 
detection of the background, foreground and mixed regions.) 

mixture-ratio-detecting step of detecting a mixture ratio of the foreground object 
component and the background object component in the mixed region; (Kondo, Fig. 2 
#104, "Mixture Ratio Calculating Unit") 
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separation step of separating at least a part of region of the image into the 
foreground object and the background object, based on the mixture ratio; and (Kondo, 
Fig. 2 #105, "Foreground/Background Separation Unit") 

motion-blurring-adjusting step of mitigating motion blurring of the foreground 
object separated in the separation step based on the motion vector. (Kondo, Fig. 2 
#106, "Movement Blurring Adjustment Unit") 

Regarding claim 12, Kondo discloses the method for processing the image 
according to claim 10, wherein the motion-vector-detecting step detects the motion 
vector every pixel in the image; and (Kondo, %0018], "generating movement vector 
information indicating each of the generated movement vectors; wherein, in the 
weighted difference image data calculating step, the weighted difference is calculated 
based on the weighting indicated by the weighting information between each pixel of the 
frame of interest of the image data and each pixel of the adjacent frame adjacent to the 
frame of interest of the image data,", where the motion vector is generated for each 
pixel) 

wherein the motion-blurring-mitigated-object-image- generating step sets the 
processing region according to the motion vector of the target pixel in the image so that 
the processing region includes the target pixel, and outputs pixel value in which motion 
blurring of the target pixel is mitigated in pixel units based on the motion vector of the 
target pixel. (Kondo, Fig. 2, where the "Movement Blurring Adjustment Unit" takes in the 
movement vector and outputs the foreground component with the movement blurring 
being mitigated.) 
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Regarding claim 15, Kondo discloses a program for allowing a computer to 
perform the following steps: 

motion-vector-detecting step (Kondo, Fig. 2 #102, "Movement Detecting Unit") of 
detecting a motion vector about a moving object that moves in multiple images, each of 
which is made up of multiple pixels and acquired by an image sensor having time 
integration effects, and tracking the moving object; (Kondo, Fig. 2 "Movement vector 
and Position information thereof".) (Kondo, ^{[1251], "In the above, an example has been 
given of a case of projecting images in real space having three-dimensional space and 
time-axis information onto time-space having two-dimensional space and time-axis 
information, using a video camera") 

motion-blurring-mitigated-object-image-generating step of generating a motion- 
blurring-mitigated object image in which motion blurring occurred in the moving object in 
each image of the multiple images is mitigated by using the motion vector detected in 
the motion-vector-detecting step; and (Kondo, Fig. 2 #106, "Movement Blurring 
Adjustment Unit") 

output step of combining the motion-blurring-mitigated object image that is 
generated in the motion-blurring-mitigated-object- image-generating step into a space- 
time location, in each image, corresponding to the motion vector, said motion vector 
being detected in the motion-vector-detecting step, to output it as a motion- blurring- 
mitigated image. (Fig. 137, "Image Synthesizing Unit", where the "Background 
Component Image" and "Foreground Component Image" are combined) 
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Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

9. Claims 6 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kondo in view of Wang et al. (Patent #5,557,684), hereafter referred to as Wang. 

Regarding claim 6, Kondo discloses the apparatus for processing the image 
according to claim 1, 

But does not specifically disclose "further comprising expanded image generation 
means for generating an expanded image based on the motion-blurring-mitigated 
image, wherein the output means outputs the expanded image to a location 
corresponding to the motion vector in a time direction." (Wang, Fig. 1 shows the mpeg 
sequence "Flower Garden" where layers are segmented. These regions can have 
affine transformations completed on them such as "zooming" (Wang, Col. 4 Lines 58- 
67), where zooming and expanding are defined to be the same thing.) 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Kondo with Wang for the purpose of identifying motion objects and 
enlarging them for further clarity. 

Regarding claim 13, Kondo discloses the method for processing the image 
according to claim 8, 

But does not specifically disclose "further comprising expanded-image- 
generating step of generating an expanded image based on the motion-blurring- 
mitigated image, wherein in the output step, the expanded image is output to a location 
corresponding to the motion vector in a time direction." (Wang, Fig. 1 shows the mpeg 
sequence "Flower Garden" where layers are segmented. These regions can have 
affine transformations completed on them such as "zooming" (Wang, Col. 4 Lines 58- 
67), where zooming and expanding are defined to be the same thing.) 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Kondo with Wang for the purpose of identifying motion objects and 
enlarging them for further clarity. 

10. Claims 7 and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kondo in view of Wang in further view of Kondo et al (Patent # 5,940,539), 
hereafter referred to as Kondo2. 

Regarding claim 7 as best understood, Kondo in view of Wang discloses the 
apparatus for processing the image according to claim 6, 

But does not disclose "wherein the expanded image generation means includes: 
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class determination means for extracting multiple pixels corresponding to a target 
pixel in the expanded image as a class tap from the motion-blurring-mitigated image 
and determining a class corresponding to the target pixel based on a pixel value of the 
class tap; (Kondo2, Lines 28-29) 

storage means for storing predictive coefficients each for predicting a target pixel 
from multiple pixels in a first image, said multiple pixels corresponding to a target pixel 
in a second image, said predictive coefficients being obtained by learning between the 
first and second images every class, said first image having number of pixels 
corresponding to the motion-blurring-mitigated image, and said second image having 
number of pixels more than that of the first image; and (Kondo2, Lines 30-31) 

predictive value generation means for detecting the predictive coefficients each 
corresponding to the class detected by the class detection means from the storage 
means, extracting the multiple pixels corresponding to the target pixel in the expanded 
image as a predictive tap from the motion-blurring-mitigated image, and generating a 
predictive value corresponding to the target pixel according to one-dimensional linear 
combination of the predictive coefficients detected from the storage means and the 
predictive tap. (Kondo2, Lines 32-37)" 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Kondo and Wang with Kondo2 for the purpose of predicting a pixel 
position by a class sort adaptive process . 

Regarding claim 14 as best understood, Kondo in view of Wang discloses the 
method for processing the image according to claim 13, 
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But does not disclose "wherein the expanded-image-generating step includes: 

class-determining step of extracting multiple pixels corresponding to a target 
pixel in the expanded image as a class tap from the motion-blurring-mitigated image 
and determining a class corresponding to the target pixel based on a pixel value of the 
class tap; (Kondo2, Lines 28-29) 

storing step of storing predictive coefficients each for predicting a target pixel 
from multiple pixels in a first image, said multiple pixels corresponding to a target pixel 
in a second image, said predictive coefficients being obtained by learning between the 
first and second images every class, said first image having number of pixels 
corresponding to the motion-blurring-mitigated image, and said second image having 
number of pixels more than that of the first image; and (Kondo2, Lines 30-31) 

predictive-value-generating step of detecting, in the storing step, the predictive 
coefficients each corresponding to the class detected in the class-detecting step, 
extracting the multiple pixels corresponding to the target pixel in the expanded image as 
a predictive tap from the motion-blurring-mitigated image, and generating a predictive 
value corresponding to the target pixel according to one-dimensional linear combination 
of the predictive coefficients detected in the storing step and the predictive tap" 
(Kondo2, Lines 32-37) 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Kondo and Wang with Kondo2 for the purpose of predicting a pixel 
position by a class sort adaptive process . 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to GANDHI THIRUGNANAM whose telephone number is 
(571)270-3261 . The examiner can normally be reached on M-Th, 7:30am to 6pm, EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed can be reached on 571-272-7413. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Gandhi Thirugnanam/ 
Examiner, Art Unit 2624 



/Samir A. Ahmed/ 

Supervisory Patent Examiner, Art Unit 2624 



